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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments with respect to the claims have been considered but are 
moot in view of the new ground(s) of rejection. 

In the response filed 07 September 2004, the applicant argues that Silverbrook 
does not state that a processing time is reduced for processing less important areas of 
the image, so as to reduce a total processing time required for processing an entirety of 
the image. Although this is not explicitly stated by Silverbrook, it is noted that by 
applying certain processing steps to only portions of an image, the processing time is 
inherently reduced compared to the case where the processing is applied to the entire 
image. It is further noted that the limitation in question appears in apparatus claims and 
is considered to be functional language which is not given patentable weight (see MPEP 
§2114). 

Claim Rejections - 35 USC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1 4, 22, 23, 27, 35 and 40 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Kao et al. (US 6,774,943) in view of Jaffray et al. (US 5,245,432) in 
view of Silverbrook (US 6,690,41 9). 

[claim 14] 
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Regarding claim 14, Kao discloses a camera apparatus comprising: a camera 
unit configured to acquire an image (c. 3, II. 5-14) and process the image prior to 
storage of the image in memory (Figure 4). However, Kao does not disclose processing 
including gray-scale-level to allocate area-dependent gray scale levels. 

Jaffray teaches artistic effects which can be applied to an image. One such 
artistic effect changes a number of grey-scale levels (Column 10, Lines 19-56) to make 
the image appear as if highlights were added in chalk (Column 1 1 , Lines 40-42). It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to use the artistic effect of Jaffray to change or "allocate" a number of grey-scale 
to make an image appear as if highlights were added in chalk. Kao in view of Jaffray 
lacks a line-of-sight detection unit configured to detect a point of eye fixation of a user 
within a camera screen, an importance computation unit configured to determine levels 
of importance for respective areas of the image acquired by the camera unit in 
accordance with the detection by the line-of-sight detection unit and applying processing 
in an area-dependent manner to thereby reduce processing time required for 
processing less important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less 
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processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Kao in view of Jaffray in order to produce 
modifications and transformations of an image in accordance with a sensed eye position 
(c. 2, II. 25-28). 
[claim 22] 

In regard to claim 22, see claim 14. 
[claim 23] 

Claim 23 is a method claim corresponding to apparatus claim 14. Therefore, 
claim 23 is analyzed and rejected as previously discussed with respect to claim 14. 
[claim 27] 

Regarding claim 14, Kao discloses a camera apparatus comprising: a camera 
unit configured to acquire an image (c. 3, II. 5-14) and process the image prior to 
storage of the image in memory (Figure 4). However, Kao does not disclose processing 
including gray-scale-level to allocate area-dependent gray scale levels. 

Jaffray teaches artistic effects which can be applied to an image. One such 
artistic effect changes a number of grey-scale levels (Column 10, Lines 19-56) to make 
the image appear as if highlights were added in chalk (Column 1 1 , Lines 40-42). It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to use the artistic effect of Jaffray to change or "allocate" a number of grey-scale 
to make an image appear as if highlights were added in chalk. Kao in view of Jaffray 
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lacks a line-of-sight detection unit configured to detect a point of eye fixation of a user 
within a camera screen, an importance computation unit configured to determine levels 
of importance for respective areas of the image acquired by the camera unit in 
accordance with the detection by the line-of-sight detection unit and applying processing 
in an area-dependent manner to thereby simplifying processing time required for 
processing less important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 1 1 ), and applying 
processing in an area-dependent manner such that less important areas receive less or 
simpler processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Kao in view of Jaffray in order to produce 
modifications and transformations of an image in accordance with a sensed eye position 
(c. 2, II. 25-28). 
[claim 35] 

Regarding claim 35, see claim 27. 
[claim 40] 
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Claim 40 is a method claim corresponding to apparatus claim 27. Therefore, 
claim 40 is analyzed and rejected as previously discussed with respect to claim 27. 

4. Claims 16, 22, 24, 29, 35 and 41 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Asiada (US 4,943,850) in view of Jaffray et al. (US 5,245,432) in view 
of Silverbrook (US 6,690,419). 
[claim 16] 

Regarding claim 16, Asiada discloses a camera unit configured to acquire an 
image and process the image prior to storing the image in memory (Figure 4). 
However, Asiada does not disclose image processing including color interpolation. 

Jaffray discloses a blur filter which averages or "interpolates" a pixel value from 
its neighboring pixels in order to give the image a blurred appearance (c. 3, II. 37-50). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use a blur filter as taught by Jaffray to add a blurring effect to the 
image. However, Asiada in view of Jaffray lacks a line-of-sight detection unit configured 
to detect a point of eye fixation of a user within a camera screen, an importance 
computation unit configured to determine levels of importance for respective areas of 
the image acquired by the camera unit in accordance with the detection by the line-of- 
sight detection unit and applying processing in an area-dependent manner to thereby 
reduce processing time required for processing less important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
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importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less 
processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Kao in view of Jaffray in order to produce 
modifications and transformations of an image in accordance with a sensed eye position 
(c. 2, II. 25-28). 
[claim 22] 

In regard to claim 22, see claim 16. 
[claim 24] 

Claim 24 is a method claim corresponding to apparatus claim 16. Therefore, 
claim 24 is analyzed and rejected as previously discussed with respect to claim 16. 
[claim 29] 

Regarding claim 29, Asiada discloses a camera unit configured to acquire an 
image and process the image prior to storing the image in memory (Figure 4). 
However, Asiada does not disclose image processing including color interpolation. 

Jaffray discloses a blur filter which averages or "interpolates" a pixel value from 
its neighboring pixels in order to give the image a blurred appearance (c. 3, II. 37-50). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
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invention was made to use a blur filter as taught by Jaffray to add a blurring effect to the 
image. However, Asiada in view of Jaffray lacks a line-of-sight detection unit configured 
to detect a point of eye fixation of a user within a camera screen, an importance 
computation unit configured to determine levels of importance for respective areas of 
the image acquired by the camera unit in accordance with the detection by the line-of- 
sight detection unit and applying processing in an area-dependent manner to thereby 
simplify processing time required for processing less important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less or 
simpler processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Kao in view of Jaffray in order to produce 
modifications and transformations of an image in accordance with a sensed eye position 
(c. 2, II. 25-28). 
[claim 35] 

Regarding claim 35, see claim 29. 
[claim 41] 
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Claim 41 is a method claim corresponding to apparatus claim 29. Therefore, 
claim 41 is analyzed and rejected as previously discussed with respect to claim 29. 

5. Claims 18, 20, 22, 25, 26, 31, 33, 35, 42 and 43 rejected under 35 U.S.C. 103(a) 
as being unpatentable over Furukawa (JP 10-191064) in view of Silverbrook (US 
6,690,419). 
[claim 18] 

Regarding claim 18, Furukawa teaches a camera unit configured to acquire an 
image and a sharpness enhancement unit configured to apply sharpness enhancement 
to an image prior to storing the image in memory (Figure 1). However, Furukawa lacks 
a line-of-sight detection unit configured to detect a point of eye fixation of a user within a 
camera screen, an importance computation unit configured to determine levels of 
importance for respective areas of the image acquired by the camera unit in accordance 
with the detection by the line-of-sight detection unit and applying processing in an area- 
dependent manner to thereby reduce processing time required for processing less 
important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less 
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processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Furukawa in order to produce modifications and 
transformations of an image in accordance with a sensed eye position (c. 2, II. 25-28). 
[claim 20] 

Regarding claim 20, Furukawa teaches a camera unit configured to acquire an 
image and a noise removal unit configured to apply noise removal to an image prior to 
storing the image in memory (Figure 1). However, Furukawa lacks a line-of-sight 
detection unit configured to detect a point of eye fixation of a user within a camera 
screen, an importance computation unit configured to determine levels of importance for 
respective areas of the image acquired by the camera unit in accordance with the 
detection by the line-of-sight detection unit and applying processing in an area- 
dependent manner to thereby reduce processing time required for processing less 
important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 1 1 ), and applying 
processing in an area-dependent manner such that less important areas receive less 
processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Furukawa in order to produce modifications and 
transformations of an image in accordance with a sensed eye position (c. 2, II. 25-28). 
[claim 22] 

In regard to claim 22, see claims 18 or 20. 
[claims 25 and 26] 

Claims 25 and 26 are method claims corresponding to apparatus claims 18 and 
20. Therefore, claims 25 and 26 are analyzed and rejected as previously discussed with 
respect to claims 18 and 20. 
[claim 31] 

Regarding claim 31 , Furukawa teaches a camera unit configured to acquire an 
image and a sharpness enhancement unit configured to apply sharpness enhancement 
to an image prior to storing the image in memory (Figure 1 ). However, Furukawa lacks 
a line-of-sight detection unit configured to detect a point of eye fixation of a user within a 
camera screen, an importance computation unit configured to determine levels of 
importance for respective areas of the image acquired by the camera unit in accordance 
with the detection by the line-of-sight detection unit and applying processing in an area- 
dependent manner to thereby simplify processing time required for processing less 
important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
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importance computation unit configured to determine levels of importance for respective 
areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less or 
simpler processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Furukawa in order to produce modifications and 
transformations of an image in accordance with a sensed eye position (c. 2, II. 25-28). 
[claim 33] 

Regarding claim 33, Furukawa teaches a camera unit configured to acquire an 
image and a noise removal unit configured to apply noise removal to an image prior to 
storing the image in memory (Figure 1). However, Furukawa lacks a line-of-sight 
detection unit configured to detect a point of eye fixation of a user within a camera 
screen, an importance computation unit configured to determine levels of importance for 
respective areas of the image acquired by the camera unit in accordance with the 
detection by the line-of-sight detection unit and applying processing in an area- 
dependent manner to thereby simplify processing time required for processing less 
important areas of the image. 

Silverbrook teaches a line-of-sight detection unit configured to detect a point of 
eye fixation of a user within a camera screen (Column 2, Lines 23-35) and an 
importance computation unit configured to determine levels of importance for respective 
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areas of the image acquired by the camera unit in accordance with the detection by the 
line-of-sight detection unit (Column 2, Line 66 - Column 3, Line 11), and applying 
processing in an area-dependent manner such that less important areas receive less or 
simpler processing than the more important areas of the image (c. 2, 1. 66 - c. 3, 1. 19). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to include the line-of-sight detection unit, and importance 
computation unit in the camera of Furukawa in order to produce modifications and 
transformations of an image in accordance with a sensed eye position (c. 2, II. 25-28). 
[claim 35] 

Regarding claim 35, see claims 31 or 33. 
[claims 42 and 43] 

Claims 42 and 43 are method claims corresponding to apparatus claims 31 and 
33. Therefore, claims 42 and 43 are analyzed and rejected as previously discussed 
with respect to claims 31 and 33. 

Allowable Subject Matter 

6. Claims 15, 19, 28, 30, 32, 34 and 36-39 objected to as being dependent upon a 
rejected base claim, but would be allowable if rewritten in independent form including all 
of the limitations of the base claim and any intervening claims, 
[claims 15 and 28] 

Regarding claims 15 and 28, the prior art does not teach or fairly suggest a 
number of gray-scale-level determining unit which increases a number of gray scale 
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levels in a first area compared to a second area that has a smaller level of importance 
than the first area as claimed, 
[claims 19 and 32] 

Regarding claims 19 and 32, the prior art does not teach or fairly suggest a 
sharpness processing unit which performs a first processing in a first area and performs 
a second processing in a second area that has a smaller level of importance than the 
first area, the first processing generating an image having higher quality than the 
second processing, and the second processing being faster than the first processing as 
claimed, 
[claim 34] 

Regarding claim 34, the prior art does not teach or fairly suggest a noise removal 
processing unit which performs a first processing in a first area and performs a second 
processing in a second area that has a smaller level of importance than the first area, 
the first processing generating an image having higher quality than the second 
processing, and the second processing being faster than the first processing as 
claimed, 
[claims 36-39] 

Regarding claims 36-39, the prior art does not teach or fairly suggest an 
importance computation unit which determines levels of importance in response to a 
distance between an area of importance and respective points in the image or based on 
a magnitude at the center of an area of importance. 
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Conclusion 

7. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Timothy J Henn whose telephone number is (703) 305- 
8327. The examiner can normally be reached on M-F 9:00 AM - 6:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wendy R Garber can be reached on (703) 305-4929. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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